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Abstract: The precise tracking of micron sized colloidal particles - held 
in the vicinity of each other using optical tweezers - is an elegant way to 
gain information about the particle-particle pair interaction potential. The 
accuracy of the method, however, relies strongly on the tracking precision. 
Particularly the elimination of systematic errors in the position detection due 
to overlapping particle diffraction patterns remains a great challenge. Here 
we propose a template based particle finding algorithm that circumvents 
these problems by tracking only a fraction of the particle image that is 
insignificantly affected by nearby colloids. Under realistic experimental 
conditions we show that our algorithm significantly reduces systematic 
errors compared to standard tracking methods. Moreover our approach 
should in principle be applicable to almost arbitrary shaped particles as the 
template can be adapted to any geometry. 
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1. Introduction 


Thanks to the pioneering work of Crocker et al. |T] the combination of video microscopy and 
optical tweezers became a versatile tool to probe interaction potentials between colloidal par¬ 
ticles |2;| or to derive the rheological properties of the host material via two-point microrhe¬ 
ology |3l|. Since then the idea to analyse the relative trajectories of two colloids close enough 
to feel their interactions has been successfully applied to systems ranging from classical col¬ 
loids |2-[T0| to optically induced forces 1 11 - 1 3]| and bio-applications 1 14 16). 

The key point of the approach is to record statistical information about relative particle po¬ 
sitions. When required optical tweezers can be used to keep the particles at a fixed average 
distance. To this end image sequences are acquired and analyzed with precise particle finding 
algorithms. Over the years, the continuous improvement of these algorithms concurrent with 
improved instrumentation has lead to a typical localization accuracy in the nanometer range for 
single particles and two-dimensional systems j8 |T7jj20) . However, one of the major limitations, 
the precise determination of the particles coordinates close to contact - when their diffraction 
patterns start to overlap - remains difficult and is still a field of ongoing research |4|6}[7| |T5j|2lj . 











Avoiding systematic errors in the particle position determination at close distances is crucial 
for tracking based pair potential measurements. Baumgartl et al. @0 used numerically and 
experimentally obtained correction curves to account for the ill-determined particle positions. 
They could show that overlapping particle images can lead to an apparent attractive component 
in the particle pair potentials. In a different approach to overcome this problem van Blaaderen 
et al. used core-shell particles where only the core is labelled with a fluorescent dye ]22) . For a 
shell that is thick enough to prevent overlapping fluorescence patterns imaging artefacts can be 
avoided m\m Crocker and co-workers @0 proposed in an iterative procedure to subtract 
the image of one of the two particles. Eventually the position of the left over particle was 
determined using a conventional tracking algorithm. 

As suggested by Gutsche et al. G3 we present in this paper a template based algorithm 
that only tracks the fraction of the particle whose optical pattern is barely altered upon the 
presence of a nearby second particle. The particles’ images are considered as the convolution 
of the optical response of the imaging system with delta functions reflecting the location of 
the particles. Splitting the optical response into a residual part - that we ignore in the tracking 
process - and a part defined through the template allows for avoiding systematic tracking errors 
due to overlapping particle images. In a control experiment we show that our method suppresses 
tracking errors down to the noise level and thus increases the position accuracy substantially as 
compared to conventional tracking algorithms. 


2. Materials 


We use an optical tweezers setup to investigate the effect of overlapping particle diffraction 
patterns on their measured center-to-center separation distance r. Fig. [T] For the trapping a near 
infrared laser beam (IPG Photonics, YFR-10-1064-FP) operating at a wavelength of 1064 nm 
and a power of —50 mW (measured at the exit of the laser) is expanded with a telescope (Thor- 
labs, 3x Galilean optical beam expander, BE03M-B) to optimize the trapping strength 1241. 


Subsequently the laser beam is fed into an oil immersion objective (Nikon 60x PlanApoVC, 
N.A.= 1.4) and focussed into a sample cell to form an optical trap. The acousto-optic deflec¬ 
tors (AA Opto-Electronics) in the trapping beam path allow for steering the optical tweezers in 
x and y directions. For the measurements melamine spheres with a diameter of 4 fi m (micropar¬ 
ticles GmbH, Germany) dispersed in a 3.3 mM KC1 aqueous solution are confined between a 
capillary with a wall thickness of 20 jim (top) and a conventional cover slide (bottom) whose 
separation distance is controlled by adding a small amount of d = 15 (Im silica spheres. The 
capillary has a total thickness of h = 20 fim (CM Scientific) and is filled with dense amorphous 
colloid composed of PMMA beads (Polymethylmethacrylat, diameter —400 nm) to form an 
opal diffuser. The whole sample cell is sealed with UV-curable glue. 

Images of the colloidal particles are acquired using an adapted Nikon Eclipse TS100 bright 
field microscope equipped with a long working distance objective (20x/0.42 EO Plan Apo 
ELWD) for the white light illumination, an oil immersion objective (Nikon 60x PlanApoVC, 
N.A.= 1.4) for both, the trapping and the observation of the particles motion using a CCD cam¬ 
era, an etch filter to filter the stray light coming from the trapping laser and a dielectric mirror 
to couple the trapping laser into the optical path of the microscope. Note, the bright field illu¬ 
mination takes place across the first diffusing layer allowing for an evenly white background 
illumination. 

With the CCD camera (prosilica GC650) we record images of 200 x 200 pixels with a frame 
rate of 90 Hz and an exposure time of 1.5 ms. With a micro-scale the effective pixel size is 
measured to be d p j X « 0.1 jum. The recorded images are analysed using a custom made tracking 
algorithm derived in this work j28) to finally obtain the particle positions on each picture. 





Camera 


Fig. 1. The experimental setup is built around a commercial Nikon Eclipse TS100 mi¬ 
croscope. A NIR laser operating at A = 1064 nm (shown in red) is used for the optical 
tweezing of the particles. Two acousto-optical deflectors (AOD) are employed to steer the 
laser beam at will. The white light illumination from above (depicted in yellow) is respon- 
sibele for the image acquisition. The inset shows a sketch of the sample cell: The colloids 
are trapped at the bottom of a sandwich construction using the technique of time shared 
optical trapping |25H27|. 


3. Template based particle tracking method 


Consider a sample with n identical particles. The image recorded by the imaging system can be 
written in terms of convolutions |29l|30|: 


7(r) = £<5(r-r,')<g>S(r) 


( 1 ) 


i— 1 


where r, describes the position of the i-th particle and S(r) the response of the imaging system 
to the particle. Eq. |T]is accurate for dilute systems where individual particles are relatively far 
apart. Applying the convolution theorem to Eq. [fallows for expressing particle locations in the 
following way m 
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where ’tilde’ denotes the Fourier transform and stands for the inverse Fourier transforms. 
The Fourier transform is very sensitive to noise and thus a Alter is commonly applied to regu¬ 
larize the transformation. We closely follow the approach described in reference |30) and use 
a Wiener Alter W = | K with K = 10 7 as a constant parameter [31]. Here |S| is the norm of 

the complex matrix S. Explicitly taking the Alter into account in Eq. [ 5 ] the term on the right 
[/(k)/S(k)] can be rewritten as J? --1 [/(k)/5(k) xff]. The same Alter is used for all subse¬ 
quent image analysis. The standard centroiding based tracking approach breaks down for two 
particles close to contact. Overlapping diffraction patterns lead to ill-detected locations |6;|. To 
circumvent these problems we use C-shaped templates and only track particle areas that are 
barely influenced by overlapping particle images. We proceed as follow: the template matrix 
and the original image must have the same resolution. Taking this into account a ring is deflned 
u 2 < (x — xo) 2 + {y — yo) 2 < (u + d ) 2 where u is the inner radius and d is the ring thickness. 
[xo : >’o] denotes the center of the ring. The intensity inside the ring is set constant with a value 
given by the mean. The background outside the ring is Ailed with white noise with a much lower 



























Fig. 2. Illustration of our template based tracking algorithm, (a) Image to be analyzed. The 
dashed lines illustrate the C-shaped particle regions that we use for tracking, (b) Backtrans- 
formed Fourier-convolved image according to Eq.[4]with a C-shape orientation ac optimal 
for the localisation of particle C (and equally suited for A). The bright spots correspond to 
the particle locations and reflect the first term in Eq.[4] The fuzzy shaped coronas surround¬ 
ing the spots illustrate the second sum in Eq. [4] (c) By choosing an appropriate threshold 
one can discriminate between particle locations and fuzzy coronas which allows for an 
precise and unbiased localisation of particle C. The same procedure is repeated to localize 
particle B using a,g = cxc — n. 


mean value compared to the ring in order to avoid overflow in the fast Fourier transform. The C- 
shape is then created by discarding the elements within certain range of angles [—1/3 tt, 1 /3tt] 
from the tracking analysis and choosing an appropriate ring thickness d ~ 0.3/?. We note that 
the choice of d and of the opening angle of the C-shape is a tradeoff between optimizing the 
measured signal and effectively excluding the overlap area from the analysis. 

Next we divide the response of the imaging system S(r) = .S'cfr. a) + .S'/.fr. a) into a C-shaped 
part Sc( r, oc) and a leftover part ,S - / (r. a) where a defines the orientation of the C-shaped tem¬ 
plate. Using this notation Eq.[T]can now be written as 

/(r) = Y j 8(r-r i )®Sc(r,a) + Y j 8{r-r i )®S L (r,a). (3) 

i=i i=t 


To avoid systematic tracking errors caused by overlapping particle diffraction pattern, the 
proper orientation a of the C-shapes has to be found. In a first iteration one chooses an ori¬ 
entation a applicable to a certain particle or a subset of particles n. For the case of tracking a 
pair of particles this task is very simple: a can be derived by orienting the C-shaped template 
symmetrically to the line connection the centres of the particles, which is not affected by the 
tracking errors discussed here. The open side of the C-shapes have to face each other and the 
position of both particles has to be anaylzed separately using the appropriate value of ac and 
ac — ft- Subsequently the particle locations are found in analogy to Eq. [2j 
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The procedure is illustrated in Fig. [2ja) showing a sample image of n = 3 identical particles 
acquired in the experiment described in the Results section. In a first iteration we chose a C- 
template Sc(r, etc) with an orientation a appropriate to localize the particle on the left side and 
thus obtain the image shown Fig. |2jb); a graphical representation of Eq. [4] The bright spots 
correspond to the particle locations, i.e., they visualize the first sum in Eq.[4] Additionally, we 
observe white coronas surrounding the bright spots. These patterns - referring to the second 









sum of Eq. [4]- compromise the tracking accuracy. We eliminate them by setting an appropriate 
lower threshold [see Fig.^c)]. Finally we determine the particle coordinates by fitting the pixel 
intensities of the white peaks depicted in Fig.[2|c) to a Gaussian. We now turn our attention to 
particle B: It can be seen that the intensity peak for particle B is slightly skewed with respect 
to the peaks for the other two particles. This is because in Fig. |2jb) the template ,S'c(r. ac) is 
adapted for particle C (and trivially to A as well). To find the coordinates of particle B we 
repeat in a second iteration the procedure from above with a new template Sc (r, a.n) with an 
orientation = ac — ft adjusted to particle B O-template). Finally we must note that due to 
the asymmetry of the C-template the measured coordinates are slightly shifted compared to 
their actual positions. This small offset can be accounted for by applying the tracking algorithm 
to an isolated particle in the same field of view as a reference (our particle A). In the situation 
depicted in Fig. [2ja), the position of particle A is detected via the C-templates first (both for 
etc and etc — 7T). Comparing the so obtained coordinates to the accurate ones determined with 
the standard tracking approach applied to particle A | T] [30|[32) allows for quantifying the offset 
precisely. 

It is noteworthy that the presented tracking method is not restricted to C-templates only. In 
principle the templates could be adjusted to track almost arbitrary shaped particles. Also the 
orientation of the templates can be adapted according to the symmetry of the particle assembly 
and could be generalized to three or more particles. An implementation of other template shapes 
and the experimental application to non-spherical particles is however beyond the scope of this 
work. 


4. Results 

To study the effect of two overlapping particle diffraction patterns we first locate two parti¬ 
cles that are irreversibly stuck to the glass substrate within the field of view of the camera as 
depicted in Fig. [3ja). The screening of the mutual electrostatic repulsion between the colloids 
and the glass surface by the addition of salt simplifies this task and leads to a situation where 
after one day a significant amount of the melamine particles are irreversibly adsorbed to the 
glass substrate. In a first experiment we then determine form a movie of lO’OOO images the 
mean position P r - (, x r ,y r ) of particle B relative to particle A using our and a conventional 
tracking algorithm |1|. We use particle A to define the origin of the coordinate system to avoid 
drift effects that possibly could spoil the accuracy of the tracking algorithms. As illustrated 
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Fig. 3. Illustration of the experimental procedure to quantify position errors due to a certain 
tracking algorithm, (a) Two isolated particles are used to determine the true position P r of 
particle B relative to A. (b) In a subsequent experiment a third particle C is trapped in the 
vicinity of particle B and its position periodically scanned. If particles C and B are close 
enough for their diffraction patterns to overlap conventional tracking algorithms start to fail 
and the instantaneous position P r (k) deviates form the true position P r . 









in Fig.|3jb), in a second experiment we record another sequence of lOO’OOO images where a 
previously freely moving colloid (particle C) is trapped in the vicinity of particle B and its 
position periodically scanned in a- direct ion using the acousto-optic deflectors. Subsequently 
we determine on each image k the instantaneous location of particle B, P,-(k) = [x r (k),y r [k)\, 
and particle C, P(k) = [x(k),y(k)], in the coordinate system set by particle A. For a correct 
tracking we expect P r (k) to be independent on the position of the trapped particle P(k), i.e., 
([x r (k),y r (k)]) = (x r ,y r ). As pointed out by Refs. @0 this implies that one possible quantita¬ 
tive measure of how overlapping particle diffraction pattern affect a correct trapping is obtained 
by plotting A r(k) = r{k) - sj\x{k) -x,.] 2 + \y(k) -y r } 2 as a function of the instantaneous sepa¬ 
ration distance between particle C and B, r(k) = ^[x r (k ) — x(k)\ 2 + [; y r {k) — y(k)] 2 . 

In Fig. [4] (a) and |4jb) we plot the tracking error Ar as a function of the instantaneous sepa¬ 
ration distance r between particle C and B in units of the particle diameter 2R. Fig.[4ja) shows 
the result for the standard centroiding particle tracking algorithm according to Crocker and 
Grier flp3) . At short separations the presence of a second particle has a clear effect on the cor¬ 
rect position determination. Indicated by the negative Ar values the instantaneous separation r 
systematically underestimates the true separation distance with an error peak around 1.1 parti¬ 
cle diameters. For comparison we also show the results of the refined spheres spread function 
(SSF) approach which provides a better accuracy but still suffers from a systematic positional 
shift toward the neighbouring particle as already noted in reference p4) . 

In Fig.|4jb) we analyse the same set of images using our template based tracking algorithm. 
The main idea is to track a C-shaped fraction of the ring shadows that is only little affected by 
interference phenomena due to a nearby second particle. We are well aware of the fact that the 
presence of a close-by second particle changes the appearance of the entire particle. However, 
it turns out that tracking the outer part of the black rings significantly decreases the tracking 
errors Ar over the whole range of separations r. 
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Fig. 4. Tracking errors Ar/(2R) vs. instantaneous separation distance r are shown as solid 
lines |6|[7). Dashed lines show the average values, (a) Error estimation for the particle 
tracking data obtained with the conventional Crocker and Grier |T| tracking algorithm (grey 
line) and with the more accurate SSF-refinement technique method J34j| (red line), (b) Error 
according to our template based tracking method. The inset illustrates the C-shaped particle 
regions that we use for tracking. The near-contact area where interference effects are the 
most pronounced is excluded form the tracking analysis. 


5. Conclusion 

Our template based algorithm allows for a precise position determination for particles close to 
contact. The tracking error due to overlapping diffraction patterns is reduced down to the noise 












level of the measurement. Therefore we expect the proposed method to simplify and improve 
interaction potential measurements based on particle tracking algorithms. It omits cumbersome 
sample synthesis steps and/or time consuming image post processing. Moreover, our results 
suggest that in future implementations such a template based tracking code could be easily 
adapted to track almost arbitrarily shaped particles or to handle three or more overlapping 
particle diffraction patterns. 
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